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Abstract 

We present an analogy between the classic Gambler's Ruin problem and the thermally-activated 
dynamics in periodic Brownian ratchets. By considering each periodic unit of the ratchet as a 
site chain, we calculated the transition probabilities and mean hrst passage time for transitions 
between energy minima of adjacent units. We consider the specific case of Brownian ratchets driven 
by Markov dichotomous noise. The explicit solution for the current is derived for any arbitrary 
temperature, and is verified numerically by Langevin simulations. The conditions for vanishing 
current and current reversal in the ratchet are obtained and discussed. 

PACS numbers: 05.40.-a, 02.70.Uu, 05.70.Ln 
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In the Gambler's Ruin problem, a player plays a series of games against an adversary, 
winning (or losing) one dollar for every success (or failure), until one of them is "ruined". 
Given the probability of winning each game, the Gambler's Ruin problem considers the 
orobability of ultimate ruin of one of the players, as well as the number of games required 
lj. In this paper, we show an intimate relationship between this classic random walk problem 
and the thermally activated dynamics in arbitrary potentials. The linkage between these 
two disparate topics is made possible by recent advances in the time quantification (TQ) of 
Monte Carlo (MC) . In particular, the evolutionary techniques for the Gambler's Ruin 
problem can be utilized to analyze the transition probabilities and the mean first passage 
time (MFPT) of the complex stochastic transport in Brownian ratchets. 

An oscillating driving force applied on Brownian particles in asymmetricperiodic poten- 
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tials (ratchets) can cause directed transport, i.e. imbalanced current 
scientific interest in the transport property of Brownian ratchets is attributed to their ro 
in biological systems, e.g. the astonishing energy-motion conversion of ATP hydrolysis j^]. 
One of the key questions in the study of Brownian ratchets is obtaining the expression 
for current. In general, the stochastic transport in the ratchets is modeled by Langevin 
equations of the form: 

1 x = -u\x 1 z{t))+m, (i) 

where £(£) is a mean zero Gaussian white noise term, i.e. = 27A; B T • 8(t — s), 

and z(t) is a Markov dichotomous process with correlation time r c . represents the 

effects of thermal fluctuation, while z(t) models stochastic processes such as impurities or 
defects jumping between metastable states Q]. The current is calculated by solving the 



corresponding Fokker-Planck equation (FPE) under periodic boundary conditions. 



the explicit current expression can only be obtained for a few simple cases js, 9 , LlO] , due 
to the complexity of dichotomous processes induced dynamics. For non-trivial cases, the 
ratchet current can be calculated by simulating the Langevin equation ll| or from numerical 
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solutions of the FPE 
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Numerical calculations are computationally intensive and do not yield as much physical 
insights as analytical solutions. Our objective is thus to derive the analytical expression of 
the current for an arbitrary ratchet potential. This is performed by first discretizing each 
periodic unit of the ratchet into a finite site chain with absorbing boundaries and analyzing 
the random walk within this chain. This is essentially the classic Gambler's Ruin problem, 



with some modifications to account for the dichotomous process. To complete the analogy, 
the corresponding time (in seconds) of one Monte Carlo step (MCS) has to be justified. 
Drawing from recent advances in quantifying the MCS {2, 3|, e.g. by linking the MC scheme 
to the Langevin dynamics via the FPE [2], we formulate a time-quantification technique 
based on the Central Limit Theorem (CLT). With this, we established the theoretical basis 
for the analytical expression of the ratchet current obtained through the MC approach. 

To explain our formalism, we shall first introduce time quantification of the MCS based 
on the CLT. Next, we model the transport in a Brownian ratchets with MC formalism and 
derive the transition probability and the MFPT in each periodic unit, and hence the ratchet 
current. The current expression is obtained for the simple thermal equilibrium case, and 
the more complex case of dichotomous noise. Finally, by applying the aforementioned TQ 
factor the current expression is verified by means of numerical Langevin simulation. 

Time quantification of the MCS is most easily introduced by considering an overdamped 
Brownian particle in a steady potential U(x,z(t)) = V(x). The random walk on x takes 
a fixed length trial move: Ax = —R,R (R <C 1) with equal trial probability in both 
directions but subject to the heat-bath acceptance rate of 1/(1 + exp(j3AV)). Here AV is 
the energy difference in the proposed transition and j3 = l/fc^T. Expanding the heat-bath 
acceptance rate, we obtain the mean and variance a of Ax in one MCS: fi = j/3f(xo)R 2 
and a 2 = |i? 2 + 0(i? 4 ) , where f(x) = —V'(x) is the external force. Since R <C 1, the 
change of f(x) within a few MCS is negligible. According to the CLT, after a large number 
n MCS the spread of displacement from xq approximates the normal distribution: 



P(Axmc) = Nfafi, na 2 ) = f(x ) ■ n^(3R 2 + rj^n^R 2 , (2) 

where ?7~iV(0, 1) follows the standard Gaussian distribution. We note that the integration 
form (Ito's interpretation) of the overdamped Langevin equation of Eq. (CQ) also results in a 
normal distribution of the displacement Ax after a time interval At: 

P(Ax LD ) = -f(x )At + n^2{k B Th)At. (3) 
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Comparing Eq. (TSJ) and Eq. ([3]), we obtain a term-by-term equivalence between Axmc and 
Ax LD if 

1 MCS = At/n = j(3R 2 /4. (4) 
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FIG. 1: Schematic diagram of a L-periodic ratchet potential. 



Since the dichotomous process z(t) simply produces transitions between the two potential 
profiles, the equivalence established in Eq. PJ is still valid in the presence of z(t), subject 
to the condition that At <C r c . This equivalence justifies the use of MC methods to analyze 
the ratchet current instead of the Langevin equation. 

We consider an L-periodic ratchet which can be divided into "supersites" of length L, 
e.g. sites % — 1, i and % + 1, as shown in Fig. ([1]). The forward and backward transition 
probability between the supersites, defined as g = p(x — »■ x + L) and h = p(x — > x — L), 
respectively, should be constant for all x corresponding to an energy minimum, due to the 
periodic property. The difference between the transition probabilities of g and h results in 
a non-zero current. We hence have the steady current: 



where t M f P t is the MFPT for the particle starting at position xq to hit either position x$ + L 
or xq — L. r MFPT is a critical factor in influencing the transport in the ratchets and has been 
studied for several limited cases 

w. 



We start our analysis with a simple illustrative thermal equilibrium Brownian 

ratchets without a driven noise. We first discretize the ratchets of length 2L into 2N + 1 
micro-sites, i.e. {S ,...,S 2 n} as illustrated in Fig. (pQ). A particle starts at site S m , and 
moves to adjacent micro-sites randomly, e.g. with steady probability fi m to site SVn-i and 
with probability w m to site S m+ i. We define g(m) as the probability that the particle from 
site S m reach the end site S 2 n before it reaches the site Sq. We further define r{m) as the 
MFPT (in MCS) for the particle to reach either end site Sq or S 2 n- Hence, we obtain the 



(x) := lim 



x(t) -x(Q) _ (g-h)L 



(5) 



t— >oo 
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difference relations for g(m) and r(m): 

g(m) = fi m ■ g(m - 1) + w m ■ g(m + 1) + (1 - fi m - w m ) ■ g{m) (6) 
r(m) = fi m ■ Tim - 1) + w m ■ Tim + 1) + (1 - fj, m - w m ) ■ r(m) + 1, (7) 

which are analagous to those of the Gambler's Ruin problem. The initial conditions g(0) = 0, 
g(2N) = 1 and r(0) = r(2N) = apply. 

The solution to Eq. i^ can be obtained by the recurrence relation: g(m + 1) — g(m) = 
{^m/w m )(g(m) — gim — 1)). Starting from the middle minima i.e. m = N, we can obtain 
the forward transition probability g between the adjacent supersites: 

where k(0) = 1, k(m) = YYtLi f i i/ w i f° r m > 1. In the last step we have used the periodic 
condition: fij = ^N+j and Wj = WN+j, which leads to k(N + i) = k(N) ■ k(i). The backward 
transition probability can be obtained immediately from h = (1 — g). Similarly for Eq. (JTj), 
after some simplification we obtain, for m = N: 



Tmfpt = t(N) = g 



N / N+i-1 \ 

■ (wikii))- 1 k U) ■ (9) 

i=l \ j=i J 



Substituting the heat-bath rate definition 1+cxp 1 ^ Ay ^ for Wi and \i{ into k(i), we obtain: 
k(i) = (wo/w^e 13 ^ = 2w (e l5Vi +e l3V%+1 ), where V{ is the potential at the ith site and V = 0. 
Particularly, k(N) = exp(/3Vjv) since wo = wn- Thus, by considering Eqs. (j4j) and (JSj), 
the current expression for ratchets in thermal equilibrium converges to the well-discussed 
continuous form [ijj as iV — > oo: 



(g-h)L L.(l-eW) 

7/3 J Q L dx e-WW f* +L dy e^v) 

We shall also point out that for = 2, our above discussion reduces to the three-state 
discrete-time minimal Brownian ratchet model [lsj] . In particular, if we replace the transition 
rates with /x- = 7/^+7/2 and w[ = 7^+7/2 following the definitions in Ref. [la ], we achieve 
the same current expression via Eq. (jSJ) directly. 

We now extend our discussion to the non-equilibrium case, i.e. with an additional dichoto- 
mous noise z(t) applied to the ratchets potential. We consider a mean-zero z(t), which takes 
two discrete values {1, — 9} (9 > 0) with correlation (z(t)z(s)) = (Q/r c ) exp(— \t — s\/r c ), 



where Q = 9r c . For clarity, we denote "+" and "— " as representing the two states z = 1 
and z = —9 respectively. Similar to our previous analysis, we define g(m; cr; a') as the prob- 
ability for a particle at initial site S m with z(t ) = cr to reach the end site S2N after some 
time t with z(t) = a' before it reaches site Sq. We also define r(m; cr) as the MFPT for the 
particle starting at S m under z(t ) = cr to reach any end sites. 

We first calculate the g(m; cr; cr'), by considering the following four difference equations: 

g(m; cr; cr') = ^ v(?\<r)- [w m g{m + 1; a; a') + lf m g{m - 1; cr; cr') + (1 - - ^ m )g{m; a; a')] , 



(1 



) 

where v(a\a) is the transition probability for dichotomous state from cr to cr in one MCS [16]. 

and \i a m denote the spatial transition rates at dichotomous state z(t) = a. Equation (flT|) 
can be rewritten into a 2 x 2 matrix difference equation. After some algebra, we obtain: 

X m+1 = W m x (A • C + W m + U m ) ■ X m - W~ l U m ■ X m _i, (12) 

where A = Tz^zfe^T+pi < 1, W m = Diag{w;+, w~}, U m = Diag{//+ , fi~ }, and 










; X m — 1 
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g(m;+;+) g{m;+; 
g(m;-;+) g(m;-;-) 

The initial conditions are Xo = 0; X2N = Diag{l, 1} = I. The additional correlation term 
(A ■ C) in Eq. ffl2l prevents a general solution for X m . Nevertheless X m can be reduced into 
a linear combination of X\ and X by recurring Eq. (fl2|) . Since X = 0, we can thus define 
a 2 x 2 matrix Q m such that 

X m = Q m -X 1 (m>l). (13) 
Q m can be expressed as a polynomial function of A: 

m— 1 

Q m (A) = ^A m "A', (14) 
where -D™ are 2x2 matrices which are given by: 

171 — 1 



^ m = E 



i=0 
m— 1 



'm— 1 



i=J L V j=i 



(15) 



in which Ki = Diag{/c 4 + , k~} where kf = YYj=it J, j/ w j- ^ n ^ ne P resen t application, we are 
typically interested in the first few factors since A = <C 1 [16]. Our experience shows 

that truncating the polynomial at 0(A 3 ) could already yield a very good approximation to 

Qm- 

Setting the starting position m = N, we obtain the forward transition probability matrix: 

G = Xn = Qn • X\ = Qn ■ Q2N1 (16) 

where in the last step, X2N = Q2N • X\ is noted. The backward transition probability matrix 
H can be calculated similarly from Eq. (Tl2l) with the reverse initial conditions: Xq = I and 
X 2 n = . 

Similarly, the calculation of r(m; a) leads to the matrix difference equation: 

W m ■ Y m+1 = (\.C + W m + U m )-Y m -U m - Y m ^ - E, (17) 

where Y m = (r(m; +), r(m; -)) T , E = (1, 1) T and Y = Y 2N = 0. Defining Y m = Q m -Y x +R m , 
we obtain after some algebra the MFPT matrix T as: 

T = Y N = (G ■ R 2N ) - R N , (18) 

where R m is also a polynomial function of A similar to Q m . The details on R m (X) will be 
given elsewhere 

We have now evaluated G, H and T. However, to calculate the steady current, we 
require the effective transition probabilities g e ff and h e s- We note S = G + H is the actual 
transition matrix for the probability distribution of dichotomous state over one transition 
between adjacent supersites. Hence, the steady state (after n — > 00 transitions) yields the 
following probabilities of the dichotomous states at the start of the (n + l) th transition: 
Prob(2; = 1) = S 2 i/{Si2 + S21) and Prob(,z = —6) = Si 2 /{Si 2 + S21). The effective forward 
transition probability is then given by g e s = ^2 aa , Prob(2; = a)g(N; a; a'), and similarly for 
h e ff. Based on Eq. (jnj), this then leads to our main result, i.e. the analytical expression of 
the ratchets current: 

_ Gn + G 22 — H u — H 22 — 2(\G\ — \H\) 
(G 2 i + H 2 i)Ti + (Gi 2 + Hi 2 )T 2 

For verification, we performed a numerical simulation based on the Langevin equation of 
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Eq. p]), and assuming a ratchet potential profile of: 

{ — iLx — z(t) ■ Fx; x < k 
y ' - _ (20) 
jztLx — z(t) ■ Fx; x > k 

r~i 

where x = x — [x/L], and k = 2/3 reflects the asymmetry of the potential [8|. In Fig. (121), 
we plotted the particle current from the Langevin simulation and found extremely close 
agreement with the predictions of Eq. (fT9l . 

Asymmetry in potential profile and dichotomous fluctuations can result in current reversal 
js]. The MC method enables us to obtain precisely the vanishing current condition (see the 
inset of Fig. [2]) which is of importance in rectifying particles with only small differences in 
7. Interestingly, since A = r±^!h = 7- 4(1+0) > from Eq. (JT3J) we found (7/t c ) determines 
the current direction. In Figs. (j2J) and ([31), we observed two facts: 1) there is a threshold 
temperature /3 C , below which no current reversal can occur regardless of 7 and r c , and 2) 
the zero-current condition curve is monotonic in character, i.e. a decrease in the required 
7/V c with increasing (3. These can be explained by considering the energy barrier between 
the supersites (AVf) induced by the dichotomous noise. In the present application, AV^ + < 
AV^~, and hence a positive current occurs in the limit of high (3. While at low (3 and large r c 
limit that r MFPT <C r c , a negative current will be formed if [exp(— f3AV^~)/9) < exp(— /3AV b ~). 
Therefore, the bottom-left (top-right) corner of the phase diagram of Fig. ([3]) corresponds 
to a negative (positive) current region, thus implying a monotonic trend of the zero-current 
surface dividing the two regions. 

Note that the analytical ratchet current in Eq. f[T^]) is derived without the assumption of 



low temperature as in lOj. Additionally, the above MC method can reasonably be extended 
to ratchets driven by an n-state process or even an Ornstein-Uhlenbeck (O-U) process [jjj] 
(an O-U process is equivalent to an infinite n-state process from the MC point of view). 
With some modifications, the MC analysis can also be applied to model the temperature 
(generalized Smoluchowski-Feynman) ratchets (J). 

To summarize, we presented a time-quantified MC method, based on and extended from 
the Gambler's Ruin problem, to analyze the directed transport in overdamped Brownian 
ratchets. By considering the transition probabilities and the MFPT between the adjacent 
minima of the periodic ratchet, we derived the analytical expression for the current in 
the presence of dischotomous noise, as well as the vanishing current condition. Generally, 
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FIG. 2: Temperature-driven reversal of ratchets current. Close agreement between analytical MC 
prediction and Langevin dynamical (LD) simulation. The simulation parameters are: R = 0.005, 
L = 1.0, F = 0.6, 6 = 0.42, 7 = 1 and r c = 0.15,0.25,0.5 from top to bottom. Error bars are 
smaller than the symbol size. Inset: extracted zero-current curve with respect to j/t c . 
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FIG. 3: The zero-current surface with respect to parameters 0, 7/V c and F. 

the MC formalism offers an alternative way to solve intractable stochastic dynamics and 
the corresponding Fokker-Planck equations. Extensions to the classic Gambler's Ruin or 



other MC problems, e.g. inclusion of correlations [18( or multiple currencies 19j . may yield 



further insights into other areas of stochastic dynamics, e.g. turbulence or high-dimensional 
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thermally activated dynamics. 
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